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ABSTRACT 

To determine the relative levels of achievement of 
students enrolled in courses designed to permit individualized 
instruction and to determine those courses or instructional aspects 
considered effective or ineffective in achieving objectives, 
achievement data on 1,204 students within the post- secondary 
insti tutes of the Wisconsin vocational education system were gathered 
from school records, and background data were obtained by 
questionnaire. Critical incidents were obtained through personal 
interviews with 224 students and 28 teachers. Analyses were performed 
contrasting student achievement and the critical incidents across 
subject areas, across technical school districts, within separate 
subject areas, and across five models of individualized instruction 
and four class scheduling patterns. Some principal findings were: (1) 

Higher grades and fewer course incompletes or withdrawals were 
received by students who possessed these characteristics, previous 
experience in the subject, high school, graduation, and enrollment in 
an associate degree program; and (2) Course characteristics which 
were most effective included student- pacing of their own programs, 
use of pretesting to place students within a course, student 
selection of special study topics, and use of different types of 
testing procedures. (Severed, pages may be light.) (SB); 
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ABSTRACT 



TITLE: 

AGENCIES: 



PROJECT 

CO-DIRECTORS: 

RESEARCH 

ASSOCIATE: 

OBJECTIVES: 



PROCEDURES: 



AN EVALUATION THROUGH FIELD TESTING OF INDIVIDUALIZED 
INSTRUCTION MATERIALS IN WISCONSIN POST- SECONDARY 
TECHNICAL INSTITUTES 

Wisconsin Board of Vocational, Technical and Adult 
Education, Madison, Wisconsin 
(Project No.: 19-003-151-222) 

The University of Wisconsin, Madison, School of Educa- 
tion, Department of Curriculum and Instruction 
(Project No.: 144-C319) 

Dr. Russell J. Hosier, Professor, Education and Business, 
Curriculum and Instruction Department, School of Education 
Dr. Harland E. Samson, Professor, Education and Business, 
Curriculum and Instruction Department, School of Education 

Dr. Judith J. Lambrecht, Curriculum and Instruction 
Department, School of Education 

1. To determine the relative levels of achievement of 
students enrolled in courses designed to permit 
individualized instruction. 

2. To determine those course or instructional aspects 
which students and teachers considered to be particu- 
larly effective or ineffective in permitting the 
achievement of course objectives. 

Within the post-secondary technical institutes of the 
Wisconsin Vocational, Technical and Adult Education 
system, 23 business courses w^re evaluated during the 
fall of 1971. These courses included the following 
subject areas: accounting (2 classes), business mathe- 

matics (2 classes), marketing (4 classes), beginning 
shorthand (3 classes), advanced shorthand (2 classes), 
and typewriting (10 classes). 

Two basic types of student achievement data were 
collected: (1) their grades in a course at the end of 

the semester, or their status as "Incomplete" or "With- 
drawn"; and (2) the teacher's categorization of a student 
with respect to his achievement in an individualized 
course (positive, neutral, or negative). These data were 
available for 1204 students. Other various types of 
background data were also collected by questionnaire for 
each student. 
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Critical incidents vere obtain* 1 through personal inter- 
views with 224 students and 28 teachers. A total of 1226 
incidents were reported by students and 378 incidents b;' 
teachers. These incidents were analyzed and categorized 
into eight main critical incident groups. 

The student achievement data and critical incident data 
were all analyzed through the use of chi-square tests of 
contingency. Analyses were performed contrasting student 
achievement across subject areas, across technical school 
districts, within separate subject areas, and across five 
models of individualized instruction and four class 
scheduling patterns which described the courses. Student 
achievement was also contrasted with the various student 
background characteristics. The analysis of critical 
incidents followed a similar pattern of contrasts: across 

subject areas, across technical school districts, within 
separate subject areas, and across five models of indivi- 
dualized instruction and four class scheduling patterns 
which described the courses. Also included in the criti- 
cal incident analysis was a comparison of the incidents 
reported by students and teachers. 

While student achievement varied across subject areas and 
schools, the number of "Incomplete" course grades suggested 
the need for further investigation to determine the final 
completion status of many students. In 16 of the 23 
courses, 60 percent of tha students or less had completed 
the course by the end of the semester. In six of the 
classes, approximately one out of five students had com- 
pleted the course requirements within one semester. 

Higher grades and fewer course "Incompletes" or "With- 
drawals" were found to be received by students with the 
following chacteristics: they had had previous experience 

in the same subject; they were in the two-year Associate 
Degree program; they were high school graduates; they had, 
in some instances, attended other educational institutions 
since high school; and, with respect to higher grades, 
they were taking a course directly related to their aca- 
demic major. Age was not related to course achievement. 
Further, students taking fewer courses or who were not 
employed outside of class were not observed to have any 
particular advantage that would cause them to receive 
higher grades. 

The critical incident analysis showed students to be more 
favorable in their attitude toward the individualized 
courses than were teachers. The majority of critical 
incidents, however, was of effective class events for both 
students and teachers. Those class characteristics which 
were most effective changed across subject areas, indivi- 
dualized instructional models, and scheduling patterns. 
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Those course aspects or characteristics which were most 
effective, however, included the following: student- 

pacing of their instructional progress.; the use of pre- 
testing to place students within a course; the choosing 
by students of special topics for study; the availability 
of the teacher when necessary for extra assistance; the 
use of materials designed specifically for individualized 
instruction; major teacher participation in the develop- 
ment of the individualized course; the use of different 
types of testing procedures within a class rather than 
just one type; the opportunity for group activities within 
a course as well as independent student progress; and the 
existence of a sufficient quantity of properly operating 
equipment when necessary. 

The continued development of individualized instructional 
materials for business courses in the Wisconsin post- 
secondary technical institutes should be encouraged. This 
development, however, should go beyond the provision of 
just student -pacing. It should alst> include more oppor- 
tunity for student selection of alternative instructional 
routes or materials directed toward the same learning 
objective. 

When these materials are to be used primarily within an 
open- laboratory situation, the professional staff in 
this laboratory should be such as to provide ample oppor- 
tunity for student- teacher contacts. The solution of the 
staffing issue within open- laboratory courses requires 
further definition of the role of the paraprofessional as 
an assistant to certified instructors. 

Continued investigation or special provisions should be 
directed toward those differences in students which are 
related to their previous background in a subject and 
their programs of enrollment in the technical schools. 

Since the initial preparation of individualized instruc- 
tional materials has been an especially time-consuming 
task for teachers, continued support should be provided 
in the way of released time for this work, as well as 
extra compensation for special projects. Further, 
greater attention should be directed toward the sharing 
of materials, evaluation instruments and course exper- 
iences among Wisconsin technical institutes. 
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PART I 
INTRODUCTION 



Background of the Study 

In the past several years the Business Divisions o£ the Wisconsin 
Vocational, Technical end Adult Education institutes have given increased 
attention to the question of whether more individualized methods of in- 
struction- should be used in their courses. While this concern for indi- 
vidualized instructional techniques has net been limited to the Business 
Divisions, the size and expanding enrollments in this area and the com- 
mitment here to newer instructional techniques through the development of 
new materials and the purchase of mechanical instructional -'aids have 
prompted the particular interest of this study. 

The assumptions in any program of individualized instruction generally 
have included the following: students learn subject matter at different 

rates and in varied ways; they are capable of being self -directed; and 
students can learn individually. In setting up instructional sequences 
which permit such possibilities as these, it is anticipated that the 
vocational needs of students will be better served. They may have a wider 
selection of courses or topics of study from which to choose. They may 
be able to start an instructional sequence at any number of places, thus 
taking advantage of any background in the subject which they may have 
acquired previously. They may enter programs at times convenient to them, 
and not necessarily only at the beginning of the fall or spring semester. 
They may, thus, complete programs or courses at irregular time intervals. 

As another beneficial outcome, it is also expected that in an individual- 
ized situation the teacher will be able to fulfill an instructional role 
more appropriate to his capabilities — the diagnosisof instructional 
problems and the assisting of students at those points at which he needs 
the direct assistance of a teacher. 



Purpose of the Study 

Several business courses now operate on the basis of the assumptions 
stated previously and with the expectation that such variable outcomes 
as were reviewed above may result. It was the intention of this research 
project to investigate and evaluate selected courses now using such tech- 
niques to determine the practical strengths and weaknesses of such on- 
going and developing course organizations. 

Several teachers have been encouraged to develop their own course 
materials and to arrange their own course to allow for more individualized 
student progress. Have the results of these reorganizations been such es 
to encourage continued effort in this direction? Are there some guide- 
lines which may be drawn from the experiences of particular schools and 
vocational-technical- institutes which may ..-assist others as they contem- 
plate. moving in thjLs.'s&me direction? 
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Tho qi.-c s zf.-.’K'j '■^hicfc could '.*.<: /ciseu with reane c.‘: to Ipdividciaii^cd 
rrairue 1 i one.?. of£<vis in «. a •; <rsa rms-'. ect'ccs a wiuz spec- 

r .y ir> the trie*.; jrr ticai bas.'.r i'c _■ - >uch iiTaivuvticCioi techniques to a 

f .-How-up cf loucn‘2 student accomplishments. !>• between these two 
e:;f r*.7.es .. tfco rvitrary purpose or this project was to examine selected 
tm->inesc -.c-rrcn *-V.ch have already been ertchlished on an individual izac! 
basis and •-. /aiuui.a the effectiveness of such course oreaniyation fro® 



two 



P'-'intr 



J. . Voat fife the student h •-. <:o a.p 1 i s l.aient 3 in ’elected c'ursb 3 
'•hcii they are allowed proceed through uo Ltfetr'iciioiial 
f'Olueiica at thaiv t :;n .. ice-' 

?. ; t fit obenwohie aspect*: o£ the c-juraes j*ay •' a identified by 

*f.ivd *>£»:« and by tcacl'y-- 1 as being nar-. Icula.vlj effective or 
paitir.alftriy inefx='.. ;. »o in conveying to students that 
c-bj -:t.£-ma*.5er contenc which they sought? 



r ; .? mlflcanr.c of .: he St udy 

Answers to such question-.' a? the two raised above are ii. tended 
provide, fii-Bt, cotajvrvzfive ntudent 'c.oicpliahr’er t -icca for rimilar hr 
contrasting ird ivi.de dlizfcd > ..« .nictionei situ-.tienf. Seco:.div, by 
de : acting tkosa cennctf- ir. -.hone opeteiicnal situstirns -Licl* ;-,ove beer- 
either partinulerlv casirai 1*-. oy c .vticulari;; ivaJiecti-: r. tic-a cf 
tangible evident: will exist "or other* by w'r.i b the;, may J edge there 
i.*ist vuctional options which u«ny a.'."ht ii-iewiss "wa’ce a-, ciiaele cr whir*' 
they should s*e.h to avoid. 

Tio magnitude of the cost co teachers and t*. the Wisconsin Voca- 
tional *• '•’oct.r.icsl districts bvhn iu time r kd in utoi\fi m r ir ravUii^g 
•ixistirg courses or in dev.loping new ones to parrait idealized 

instir.wticr* j.n u ich that every effort should be made to she::® or profit 
from the trpet fences of those who have already undertaken such costs, 
j-iich a sharing cf the experiences in on-going situations is a very prag- 
aiatf.c approach >:o a ? evaluation of the efforts to develop individualized 
ins u rue iionsl rvo?i v *a Ji3 . It dons not seek to provide answers to the very 
' qucecioi.: ja bow scuden-tr. i-.arn or nhe *££*» c-*v of - i .- ••’•:>. ant test- 
••met i or,al arocoachec on l , i' , r:.ir..^ outcome' . 

Baforo suvi. questions e.c th**n® car. be f.ckc’i in :hz ^pacific frama- 
worl: of in a * T ;.ccon3in Vocational Technical Institutes, iL is necessary 
first fcnv:: run bridge from L- o y^re tracitioncl classroom organization 
to :he individualized, more open end flexible Instructional situation 
ha crossed. Until it can be satisfectorily don.-uct rated that the indi- 
vidualized.. s tt-dent -c : I'r.o 1 ieci situation err-, be a viable and cparatior.el 

native to the group-. rricriftd approach, o more penatiating examine 
bio-, c <c the individualized alternatives which be available is not 
possible. The turked iransiton required tor Loth teachers and students 
to a pattern of in? tructior.- which is different from accustomed clans 
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organizations might be made more e c =• i ] •> v:-.an it hrs already been deiron- 
Ptrsted in similar situations that such a transition would be oest to 
include or avoid selected options. It is such a practical evaluation 
and possible guidelines which were sought in this project. 



Design of the Study 

Two major types of data were collected with the purpose of 
evaluating 23 selected classes covering seven business subject areas. 

The first sought to determine the completion status at the end of one 
semester for each student in the course. Also collected in association 
with the completion status were certain background characteristics, such 
as a student's major, the program in which he was enrolled, whether he 
was 4 high school graduate, and whether he had previously had experience 
in the same subject in which he was now enrolled. 

The second type of data were critical incidents obtained from both 
students and teachers in the 23 courses using a form of individualised 
instruction. These incidents were events singled out by a student or 
a teacher which they considered to be examples of either particularly 
effective or particularly ineffective aspects of the individualized 
course. The analysis of both of these types of data is explained more 
fully later in the section entitled Methods and Procedures. 



Limitations of the Study 

In evaluating selected business courses which were currently using 
a form of individualized instructional procedures, an effort was made 
•'c examine these courses solely as they had been organized by the 
respective teachers. Because of this examination of on-going courses, 
or the omission of any formal experimentation, the following limitations 
should be recognized: 

1. There were no control classes in operation against which 
any of the individualized classes could be compared. Any 
comparison by teachers with what could be considered the 
traditional way of teaching a given subject was based on 
their previous experiences with the same course as it was 
taught before being individualized. 

2. Because only 7 of the 23 classes in this study used a form 
of pretesting and student placement, it was not possible to 
compare student end-of-the-semester progress with a previous 
test score in the same area. Even those classes which did 
use a pretest did not re-administer the same test as a final 
course measurement. 

3. Course achievement, or satisfactory completion of a given 
individualized subject, was based on a student's successfully 
meeting the objectives established for a course. Tnoae stu- 
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dents who were rot cl. 1- :o o^wlsfactcrily complete these 
objectives, were. :’.n .ms:: classes, :t he coat:' cue 

the course wo vie beyond r.*.e i>.o«s3tov. 

While it is anticipaf.ee that the findings of this otudy 
involvj.ny 23 selected business courses will have application 
to similar courses in other technical institutions in Wisconsin, 
the specific findings may not be generalized beyond the stu- 
dents in these 23 situations. The courses themselves were net 
a random sample from the individualized Instructional programs 
in Wisconsin technical institutions. 

5. The 23 classes which have been used here as the basis for an 
evaluation of individualized instructional procedures, could 
net 1.3 considered a complete representation of the business 
courses in Wisconsin Vocational, Technical, and Adult Educa- 
tion s’/atera which have been individualized. These subjects 
»v*i:a chosen as representing several subject trees end several 
different approaches to the individualization, of a course; 
they do not include many other business courses which have 
been individualized. The necessity of visiting these courses 
as often as possible also limited the number which could be 
included in this follow-up. 



Da limit & ti or s of the Study 

Tiie findings of any study are subject ac t*na restrictions that they 
apply to those schools and classes frem which ftr.c data were collected. 
Correspondingly, the following delimitations are uade: 

1. The findings of this study are delimited to the participating 
post-secondary schools and to the specific business courses 
within these institutions. The .following were the ten dis- 
tricts and the twelve different schools of the Wisconsin 
Vocational, Technical, and Adult Education system which 
participated in this study: 



D.i. 3 

District 4 
District 5 

District 6 
District 3 

District 9 



- Southwest Wisconsin Vocation.;!. -Technical 
School, Fenniaore 

- Madison Area Technical College, Madiscn 

- Blsd'.hawk Vocational-Technical School, Beloit 
BlachhawU Vocational -Technical School, Janesville 

- Kenosha Technical Institute, Kencsha 

- Waukechw County Technical Institute, Wauxesha- 
Pewaukee 

- Milwaukee Area Technical College, Milwaukee 
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District 10 - Moraine Park Technical Institute, Fond du Lac 

District 11 - Lakeshore Technical Institute, Sheboygan 
Lakeshore Technical Institute, Manitowoc 

District 12 - Fox Valley Technical Institute, Appleton 

District 15 - North Central Technical Institute, Wausau 

2. Within the ten districts enumerated above, five main subject 
areas in business were included. The subject areas were 
accounting, business mathematics, marketing, shorthand, and 
typewriting. These courses in different schools included 
students enrolled in two-year associate degree programs, and 
one- and two-year vocational diploma programs. The initial 
enrollment in the 23 classes included in this study was 1206. 
Of this number, data were available for 1059 for the final 
analysis. In these 23 classes, there was a total number of 
28 different teachers involved in the instruction. 
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PART II 

KT.'l; ILOLCCY 



Selection of C o urs e s for P o llow-up 

Since it ’-’as not possible to include all of the business courses 
in the Wisconsin Vocational, Technical, and Adult system which had been 
organized by the fall of 1971 utilizing a form of individualized ins true 
tion, it was necessary to select those which had been considered repre- 
sentative cf the most innovative instructional procedures. To exclude 
other courses was not a judgment of fchsir importance or of the difficul- 
ties encountered when any r.curse is reorganized to permit a different 
instructional approach. Tnose courses which were chosen represent sub- 
jects in which some of the greatest effort and resources are now being 
directed witn respect to individualized instruction, such as typewriting 
and also such subject areas where little attention has thus far heen 
giver., such as come of the areas of marketing. Tarsia I summarises the 
ccucses offered in the fall semester of 1971 which were a part of this 
follo\7-up and evaluation. 



The data for this stjely wera, therefore, collected from 23 classes 
grouped in. the following categories: typewriting, 10 classes (to be 

further classified as using a tevtbook or an audio-visual-tutorial 
approach); shorthand, 5 classes (Jr eluding both beginning and advanced 
classes); accounting, 2 classes; business raa thermal ics, 2 classes; and 
marketing, 4 classes. All of the students in these courses were "day" 
students, most of them full-time students. 

While :‘.r. s rme schools the fieid-stvvices students (generally 
"evening" students) and students in special programs (such as MDTA and 
WIN) used the same facilities as the* regular "day" students, these 
students ware not included in the follow-up and evaluation. Altho -gr; 
some of these fit.lJ- service and special students were attending son? . ' 
the "open lab" classes during the day because of the accessibility oi 
these facilities, it was not considered appropriate to combine these 
students with the regular day-time enrollment. 
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ZAULE J 

Courses Included in the V-r c* 
of Individual^ -no Irt'—iuctienai 5 iuu.it Ion.- 



District and School 



Course Name and N" "Der 



No. 3 

Southwest Wisconsin 
Vocational-Technical 
School* Fennimore 

lie. 4 

Madison *»rea Technical 
College, Madison 



No. 5 

Blackhawk Vocational- | 

Technical School - Beloit 

i 

Blackhawk Vocational- 
Technical School •• 
Janesville • 



Business Mathematics (804-302) 
Business Accounting I (101-311) 

Salesmanship (104-310) 
Typewriting II - Legal (106-133) 



I 



Typewriting I and II (106-131, 106-133, I 
106-331, 106-333) ! 

Typewriting I and II (3.0 105-333) 



No. 6 



Kenosha Technical In*t. ho rice Ling Display (ud'4-119) 



Mn. 8 , 

Waukc*s v a County Technics? 
Insuitete, Waivkeshs ■ 
Pewrulcee j 

I 



No . 9 ! 

Milwaukee / ro.j Technical . 
College, Milwaukee 



! 

Typewriting t and II (106-13?., 105-133. i 
106-331, ICC- 333'- ! 



Won-Texfcii.es (.Market? ->g) (104-121) 
Fashion Fabrice (Marketing) 104-117) 



No. 10 

Moraine Fark Technic? ?. 
Institute, Fond du lac 



Beginning Typewriting (ICC >31) 

Beginning Shorthand (106-305) i 

Accounting (101-301, 101-331, 101-313) j 

Business Mathematics (R Bus . 300, 

R Eus. 301. 1: Bu3 302) ! 

* i 

i 

Typewriting I a.id II (106-131, 105-33... 
106-333) 
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1A3I,1: I (cont'd; 



District and School 



No • 11 

Lakeshore Technical 
Institute, Sheboygan 



Lake-shore Technical 
Institute, 'Manitowoc 



i 

Course Name and Humber 



t 

j 

Typewriting I and II (106-131, 106-133, • 
106-331, 106-333, 105-360, 106-362, I 
106-364) | 

i 

Shorthand I (106-111) | 

» 

i 

Shorthand III (106-115) ! 

I 

I 

Typev?riting I, II, and III (106-131, j 
106-133, 106-135, 106-331, ICG-333, j 
106-335) 



No. 12 

Fox Valley Technical 
Institute, Appleton 



j Shorthand I (106-111, 106-311) 

t 

Shorthand II and III (106-113, 106-115, 
, 100-513, 106-315) 



! Typewriting I and II (106-128, 106-131 i 
j ICS-340, 105-341) ' ! 



Ho. 13 

North Central Technical 
Institute, Wausau 



Typewriting for Printers (106-320) 



I 

►— . 
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Cat os crics o r Mod •- ? s c f Inc * v i.c u ; 1 1 4 •r e d Instruction 

If order to fpl 1 itate the rnalysis end allow comparison among '.ho 
different, classes. -11 23 of the classes wore characterized by two 
me toads. I'd* at , by the typo of individualized instructional approach 
*which v?as beinj used; and, secondly, by '.-.he class, scheduling pattern used. 

l: individualized course may be developed in c wide variety cf ways 
depending upon the subject matter of the course, the materials and facili- 
ties available, and the time and resources available tc the teacher. To 
permit comparison among the different classes and the different subject 
areas, the 23 ciast.es included in this study were categorized into five 
broad approaches tc individualized instruction. Each of those categories 
represented ?. gradual progression of increasing options available to 
st.vls.fits in av. individualized situation .via were net related to any • 
particular subject matter or materials. These five categories wore 
after the investigator had observed ail of the course? and 
were bsscu initially on the categories presented by CronLach. (1^57) 

These five categories ere listed below: 



1. Objective to develop student to designated criteria by al- 
tering the duration of instruction. Fr::ed instructional 
tract:; tio ir.i' ial placement ' - a variety cf levels. ( L3 
classes) 

2. Objective to develop stvd'd I.j design':-. _ed criteria by mi- 
tering the duir.tion of in. tract 4 cn. fixed track; initial 
pre-testing and placement r.ft a *'_riety of levels. (6 classes) 

3. Objective tc develop stt.der.t to designated criteria by alter- 

ing the duration of i;istvvo!.:.cv\. Fixed track; initial pre- 
testing and pi -*.u finent c.t vail*.. la /els. Integrateo retr.ed- 
iai c/1 juncts to a fixed r r v;k‘ instructional sequence. 

(1 class) 

4. Objective tc develop student ...» designated criteria wit! 
provisions for student selection of convce-unit progression. 
Duration of progression flexible. '2 classes) 

b. objective to develop student to individw *.ly selected criteria 



.tx! 



) the use. of different instruction - l secuenr.es for each. 



?ie- testing and placement are incorporated late the construc- 
tion cf the- instruct lend sequence, 'i c t?«*r.) 




-The instructional ’nat*.' ie Is ar.d procedures in er-ch one of these 
2b ula-ses are nesciiboii more completely in the Appendir. of this 
report. 
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Courses Include * 5 Kitr.tu : :i **t thfc Five 
Individual i.^-d Intr. Models 



— 

Model 

No. 


Courses 

. 


V.T.A.E. District and 
School Locatin'. 


i 

1 . 


Business Mathematics 


No. 3, Fennituc re 




Business Accounting I 


No. 3, Fennimort 




Salesmanship 


No. 4, Madison 




Typewriting II - Legal 


No. 4, Madison 




Typewriting I red II 


No. 5, Beloit 




Typewriting I and II 


No. 5, Janesville 




Fashion Fabrics (Marketing) 


No. 8, Waukesha 




Typewriting I and 7.T. 


No. 8, Waukesha 




Accounting 


Nr. 9, Milwaukee 




j 

Beginning Shorthand 


! Me. 9, Milwaukee 




1 

Shorthand I 


| 

; No. Ij, Sheboygan 
1 




Shorthand XU 


1 

! No. 11, Sheboygan 




Shorchcnd I 


No. 11, Manitowoc 


2 


i 

Engines 3 Arithmetic 


• No. 9, Milwaukee 




Typewriting I ar-d II 


1 

I L!o. 10, Fond du Lac 




Typewriting I and II 


| No. 11, Sheboygan 




Shorthand II and III 


No. 11, Manitowoc 




Typewriting I and II 


No. 12, Appleton 




Typewriting i'er Printers 


No. 15, Wausau 


o 


Typewriting I. II, and III 


No- il, Manitowoc 


6 


Marketing Display 


! No- 6, KancsUa 

i 


i 


! Kon-Textilt-s 

i 


; No. •?, Wadccsha 


| 5 


1 

I Beginning Typewriting 


| No. 9, Ni'wa'dcoe 
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Scheduling Patterns Used In the Individualized Courses 

In any individualized course, the availability of instructional 
facilities has been assumed to have a marked effect on the flexibility 
allowed to the students. The ease with which they may use equipment 
and materials and receive extra assistance from the instructor are all 
affected by the scheduling of the class activities. The 23 courses 
followed up in this project used a variety of scheduling patterns which 
might have affected the progress of the students or their attitudes 
toward the course. For comparative purposes, these scheduling arrange- 
ments have been categorized according to the following four main options. 

1. All classes scheduled to meet at a designated time (10 classes) 

2. Some classes scheduled to meet at a designated time; some 
classes released for independent student work. (3 classes) 

3. All classes scheduled to meet at a designated time; laboratory 
facilities available for extra course work in addition to the 
scheduled class. (4 classes) 

4. No classes scheduled; all work completed in an open laboratory 
at a time chosen by the student. (6 classes) 

Table III summarized the specific courses which were included in 
each of the four scheduling patterns. 



TAELE III 

COURSES INCLUDED HUT: HI EACH OF 
FOUR SCHEDULING PATTERNS 



Schedule 

Pattern 

No. 


Courses 




1 


Business Mathematics 


No. 3, Fennimore 




Business Accounting 


No. 3, Fennimore 




Typewriting II - Legal 


No. 4, Madison 




Non-Textiles 


No. 8, Waukesha 




Fashion Fabric (Marketing) 


No. 8, Waukesha 




Beginning Typewriting 


No. 9, Milwaukee 




Accounting 


No. 9, Milwaukee 




Easiness Mathematics 


No. 9, Milwaukee 




Beginning Shorthand 


No. 9, Milwaukee 




Typewriting for Printers 


No. 15, Wausau 


2 


Salesmanship 


No. 4, Madison 




Typewriting I and II 


No. 8, Waukesha 




Shorthand I 


No. 11, Manitowoc 


3 


Marketing Display 


No.- 6, Kenosha 




Typewriting I and II 


ITo. 10, Fond du Lac 




Shorthand I 


No. 11, Sheboygan 




Shorthand III 


No. 11, Sheboygan 


4 


Typewriting I and II 


No. 5, Beloit 




Typewriting I and II 


No. 5, Janesville 




Typewriting I, II, and III 


No. 11, Sheboygan 




Shorthand II and III 


No. 11, Manitowoc 




Typewriting I, II, and III 


No. 11, Manitowoc 




Typewriting I and II 


i No. 12, Appleton 
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Evaluation Techniques 

Two main methods were used to evaluate the progress of the students 
In the Individualized courses and the aspects of these courses which 
were particularly favorable or unfavorable from the students' and the 
teachers' view points. For convenience of reference, the first analysis 
has been identified as an analysis of student background and completion 
data. The second analysis has been identified as a critical incident 
analysis. Each will now be described briefly. 

1 . Stude nt Background and Completion Analysis 

(a) Determination of Student Achievement or Completion Status 

It is considered essential in an evaluation of any 
of the individualized courses that the accomplishments of 
the students be examined according to their achievement of 
the specified course objectives. This achievement was to 
be determined, however, through the use of the measurement 
device or techniques which the teachers were already using 
in their respective courses. Measurement instruments were 
not introduced in this project which were in addition to 
those normally used in these courses. 

In order to permit a comparison among different classes, 
course completion was recorded according to the grading 
device used by the individual teachers, or the letter grades 
assigned at the end of one semester. The description of the 
specific accomplishment of those students who received the 
various letter grades must be surmised from the description 
of the course objectives or the grading scale, where avail- 
able. 2 

The completion status of students in all of the indi- 
vidualized courses fell into three basic categories. First, 
those who completed the course before or at the end of one 
semester received a letter grade. Generally these grades 
ranged from A, 3 to C. In a few instances the grade of ‘'D - ' 
was also used. No F's were assigned in any cf the classes 
since a student who did not complete a course was to be 
permitted extended time to do so. In a few courses where 
extended time periods were not possible, students were 
assigned letter grades on the basis of the amount and 
quality of their work completed. 

As a second category, those students who did not com- 
plete the courses within one semester, but who did not 
withdraw formally, were to be allowed additional time to 
complete the course. Those students in this category were 
identified simply as 'Incomplete.'' 



2 These course objectives are provided with the course descriptions 
in the Appendix of the study. 
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Thirdly, students who withdrew formally from a course 
before the end of the fall semester were identified as 
"Withdrawals." 

As a second means of assessing the progress of students 
in the individualized courses, the teachers in each course 
were asked to make a subjective judgment of a student's 
achievement. It was felt that an additional means of 
assessment was necessary to guage the state of the progress 
of those students, in particular, who were rated as "In- 
complete." Such an incomplete status might connote lower 
accomplishment than a regular letter grade, or it might be 
judged as an extension of what could normally have been a 
failure. Since the individualized, self-paced aspect of 
these courses was designed to maximize a student's achieve- 
ment in a given subject and to permit him to vary the time 
necessary for an established minimum level of achievement, 
such a judgment should not be made about the "Incomplete" 
category. 

In order to extend the assessment of students' progress 
beyond that provided by the regular letter-grade classifi- 
cation, teachers were asked to place all students into one 
of three categories. This subjective judgment was assumed 
to be made by the instructor with consideration given to 
previous experience by the teacher in the same or similar 
course when it was taught on the regular group basis. The 
following were the three student-progress categories in an 
individualized course: 

1. The student might not have been able to accomplish 
as much in a regular, group-organized class as he 
did in the individualized situation; or he did 
better in the self-paced situation than a regular 
class might have permitted. (Positive category) 

2. The student would probably have done just as well 
in a regular class as he did in the individualized, 
self-paced situation; or the individualized situa- 
tion seemed to make no difference in the student's 
accomplishment. (Neutral Category) 

3. The student may have profited more from this course 
if it had been taught in the traditional manner; 

or he did less well in the individualized class 
than he may have in a more structured situation. 
(Negative Category) 

For those classes in which such information was appro- 
priate, the following types of student completion data were 
also collected: 
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1. The number of hours spent during a semester in a 
class to reach the completion level attained at 
the end of the semester; 

2. The advance placement of a student within a cours? 
such that he was not required to proceed through 
all of the regular semester assignments in order 
to satisfactorily meet the course requirements; 

3. Early completion of the course requirements, or 
finishing a given course before the end of the 
fall 1971 semester. 



(b) Student Background Data 



O 

ERJC 



Various student background data were collected for the 
purpose both of having some basic descriptive information 
about the students in the respective individualized courses 
and of comparing this background information with the 
students' course accomplishments. These data were obtained 
through the distribution of questionnaire-type data sheets 
to the students enrolled in each course. 3 Students who 
withdrew from a course before such forms were made available 
did not, of course, complete one. The following information 
collected on this form was used in the comparative analysis 
with student course achievement: 

1. Age of student 

2. Major course of study 

3. Program of study such as two-year associate degree 
program, two-year vocational diploma program, one- 
year vocational diploma program, or other 

4. The number of semesters which a student has atten- 
ded the particular technical institute in which 

he is currently enrolled. 

5. High school graduation status 

6. Previous attendance at another educational insti- 
tution. since high school 

7. Previous business courses taken in any school, 
with the objective of identifying previous enroll- 
ment in the same subject matter in which the 
student is currently enrolled 



study. 



copy of this questionnaire is 



included in the Appendix of this 
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8. The number of different classes in uhich a 
student was currently enrolled 

9. The number of hours per week in which a student 
was scheduled to attend class 

10. Current employment status of the student and the 
number of hours employed per week 

11. The reason the student was currently enrolled in 
the course, marked from among several reasons 
listed. These reasons were categorized as either 
primarily vocational or not vocational. 

In order to compare various levels of student achieve- 
ment with these selected characteristics, the chi-square 
contingency method of analysis was used. The various 
levels and categories of achievement were compared not only 
with these selected characteristics, but also among the 
various subject areas, the five models of individualized 
instruction situations, and the four scheduling patterns. 
Comparisons of student achievement were also made among the 
twelve different schools and among different teachers within 
these schools. 

2. Critical Incident Analysis 

The second major form of analysis was directed toward 
identifying those aspects of the selected individualized courses 
which were considered by both the students and teachers to be 
particularly effective or particularly ineffective in permitting 
them to accomplish the objectives they desired in the class. In 
order to identify those course features which the students and 
teachers felt to be particularly important, the critical incident 
technique of analysis was used. This technique developed by 
Flanagan (1954) has previously been used to identify favorable 
or unfavorable characteristics of persons as they perform in 
designated roles, such as teaching. As it was used in this 
study, however, characteristics of individual courses were the 
objects of interest. It was considered that this method could 
be extended to identify activities within a course which students 
and teachers considered to be particularly significant since it 
would provide a means of avoiding mere opinions or attitudes 
about the course. The critical incident technique did provide 
a direct means of singling out activities in a course which had 
in turn led to either favorable or unfavorable results. The 
following is a description of the critical incident technique 
as it was developed by John C. Flanagan (1954): 

The critical incident technique consists of a set 
of procedures for collecting direct observations of human 
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behavior In such a way as to facilitate their potential 
usefulness in solving practical problems and developing 
broad psychological principles. 

By an incident is meant any observable human activity 
that is sufficiently complete in itself to permit inferences 
and prediction to be made about the person performing the 
act. To be critical, an incident must occur in a situation 
where the purpose or intent of the act seems fairly clear 
to the observer, and where its consequences are sufficiently 
definite to leave little doubt concerning its effect. 

Certainly in its broad outlines and basic approach, 
the critical incident technique has very little which is 
new about it. . . perhaps what is most conspicuously needed 
to supplement these activities is a set of procedures for 
analysing and synthesizing such observations under more 
carefully controlled conditions. 

In order that the final list of job requirements be 
valid, it must necessarily be based on data representing 
not the opinions or beliefs of the members of the group, 
but their actual experiences in the form of reports of • 
behavior which led directly to the success or failure of 
the individual on important parts of the job. It is impor- 
tant that these behaviors be identified by those who 
describe these as especially effective or ineffective 
according to their own standards, not those of any outside 
person or group; also they should not be derived from 
stereotyped concepts traditionally listed whenever defini- 
tions of successful researchers are requested. For these 
reasons the Critical Incident Technique requires that 
reports of critical incidents be confined to descriptions 
of what actually occurred, leaving out inference or inter- 
pretation. 



It should be noted that the critical incident technique is 
very flexible and the principles underlying it have many types 
of applications. Its two basic principles may be summarized as 
follows: 

(a) reporting the facts regarding behavior is preferable 
to the collection of interpretations, ratings and 
opinions based on general impressions. 

(b) reporting should be limited to those behaviors which, 
according to competent observers, make a significant 
contribution to the activity. 
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In summary, the critical incident technique, rather than 
collecting opinions, hunches, and estimates, obtains a record 
of specific behaviors from those in the best position to make 
the necessary observations and evaluations. A list of subsequent 
critical course aspects provides a sound basis for making infer- 
ences as to requirements in terms of necessary or desirable 
course options, less desirable provisions, and other characteris- 
tics of classroom operation. 

Several other studies which have incorporated this research 
technique have come to a number of conclusions as to its most 
effective application. With respect to the means of collecting 
the incidents, it has been observed by Blair 0.902) and Farrar 
(1962) that the personal interview is an effective means of 
obtaining the incident data. Further, students have been con- 
sidered to be good observers of critical incidents. (Samson, 

1964) They are both reliable and valid indicators of teachers' 
behaviors, for example. 

With respect to the development of meaningful categories 
for analysis from the incident data, it has generally been found 
that significant categories may be established through the 
collection of a large number of incidents, and it is generally 
found that a large number of incidents will result in a much 
smaller number of categories. These categories are usually 
judged on the grounds of their "meaningfulness•' -- this being 
related to the degree of their specificity. Samson (1964) 
has suggested that when the normal procedure of category formu- 
lation and classification, using judges recognized as expert in 
the area, is followed, the categories developed did seem to be 
significant to the degree that the incidents were true and 
accurate as reported by the observer. It is expected that the 
critical requirements or aspects of courses derived from a 
critical incident study should provide insight into desirable 
behavior patterns and several as an effective basis for the 
further development of testable hypotheses. 

In tha current project, both students and teachers were to 
be the observers of those classroom activities which to them 
were particularly effective or particularly ineffective in 
leading toward the accomplishment of the course objectives.^ 

All of the 28 instructors in the individualized classes were 
asked to provide this kind of critical incident information. 

In all of the 23 classes it was decided that a minimum of six 
students should be selected randomly for the purpose of obtaining 
this type of personal interview. In two classes, time did not 
permit this number of interviews, each interview requiring 



^The preliminary explanatory statements ..which were verbally pre- 
sented to students and to teachers as a part of the critical incident 
interview have been reproduced in the Appendix. 
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approximately thirty minutes. In seventeen classes, more than 
six students were available for such thirty-minute interviews. 

In the remaining four classes, six students were interviewed. 

Table IV is a summary of the 23 classes induced in the 
study, the initial enrollment, and the number of students inter- 
viewed. In all cases, the first six students were selected 
randomly from teachers' record books or as they entered the 
classroom. Beyond this number, students were taken from the 
course to talk with the investigator is time and their conven- 
ience permitted . 

From the 224 student interviews, a total of 1226 separate 
incidents were obtained. From the 28 different teachers inter- 
viewed in the 23 classes, a total of 378 incidents were obtained. 

These incidents for both groups, students and teachers, 
were analyzed by the investigator and placed into categories 
considered to be descriptive of the activities identified. Each 
incident was also classified as either effective or ineffective 
as evaluated by the student or teacher. 

Before any analysis of these data, the categories were 
cross-validated for a 10 percent random sample from the stu- 
dents' incidents. Six persons knowledgable of the business 
and distributive education fields were asked independently 
to classify 126 incidents using the categories developed by 
the investigator. Had there been substantial divergence in 
the categorization of these incidents, a re-analysis of the 
categories would have been necessary. The findings of this 
cross-validation are presented with the other analyses of these 
data in the next major section. 

After all of the incidents from the student and teacher 
groups had been categorized, several chi-square contingency 
analyses were performed . The major categories of the incidents 
were compared successively with the subject areas from which 
they were obtained, the district in which the schools were 
located, the model of the individualized class, and the schedu- 
ling pattern used. The quality of the incidents as they were 
categorized, either effective or ineffective, was also com- 
pared with the subject area, the district in which the schools 
were located, the model of the individualized course, and the 
scheduling pattern. Comparisons were also performed between 
the student and teacher groups with respect to the incident 
categories and their auality as favorable or unfavorable. 
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TABLE IV 

COURSE ENROLLMENTS AND 
NUMBER OF CRITICAL INCIDENT INTERVIEWS 



District 

1 


Course Title 


Initial j 
Enrollment 1 


Students 

Interviewed 


1 

I 3, Fennimore 


i 

Business Mathematics | 


24 1 


3 ! 




Business Accounting I ! 


27 1 


7 

J 


4, Madison 


Salesmanship 


58 | 


13 | 


i • 

j 


Typewriting II - Legal 


14 


11 ! 


5, Beloit 


Typewriting I and II 


140 ! 

i 


13 ! 


5, Janesville 


Typewriting I and II 


51 


i 

7 ; 

1 


6, Kenosha 


Merchandising Display 


30 i 

t 


14 ! 

i 


8, Waukesha 


Non-Textiles ! 


31 ; 


1 

9 j 


1 Fashion Fabrics 


17 i 


6 ! 


1 


Typewriting I and II 

| 


141 | 

i 


9 ! 

1 


9, Milwaukee 


1 Beginning Typewriting 


t 

52 ; 


8 ! 




j Accounting 


62 i 


15 




Business Mathematics 


38 


11 




j Beginning Shorthand 


31 


9 


10, Fond du Lac 


j Typewriting I and II 


l 

57 


i 

16 


11 , Sheboygan 


• Shorthand I 


16 


6 




! Shorthand III 


11 


6 




| Typewriting 1 and II 


16 S ; 

$ 


15 

i 


'll, Manitowoc 


| Shorthand I 


19 


1 

4 j 




j Shorthand II and III 


15 


6 i 




; Typewriting I, II, and III 


81 ! 


12 


12, Appleton 


i 

j Typewriting I and II 


104 | 

» 


16 


15, Wausau 


i 

j Typewriting for Printers 

i 


h-» 

CO 


8 



•i 
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Summary 



The preceding has been an introduction to and discussion of the 
procedures followed in this study. First the basis for the selection 
of the 23 individualized instructional classes included in this study 
was discussed. Hext, these 23 classes were divided into two descriptive 
categories: the model which characterized the degree of individualized 

instruction in the classes and the scheduling pattern of the classes. 

L-stly, the procedures which were followed in the analysis of the 
data were discussed. Two different types of data were analyzed: student 

achievement data within each of the 23 classes > and the critical incidents 
in these classes which were reported by both students and teachers. 
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PARI' III 

rr’Diuos Aiir» /.ualycir of mta 



In order to Identify those course aspects of individualised in- 
structional situations which were contributing most or which were act- 
ing ns deterrents in reaching desired course objectives, 23 courses were 
evaluated. These courses represented five different subject areas which 
included 1204 students and 20 instructors.* 

Two primary types of data analysis were performed in this study. 

The first lias been identified as an analysis of student bad •'’round and 
course completion, data. The second has been identified as a critical 
incident analysis, 'inch of these is presented as a major subdivision 
of this section of the report. 

In order to minimize the presentation of tables in the main body of 
the report, the numerical presentations of many of the findings have been 
included in a separate Technical Appendix. While the findings from all 
of the major aspects of these analyses have been included here, the tables 
from Tillich many of the findings were drawn may be referenced in the sepa- 
rate Appendix. 

The statistical procedure used in making all of the comparisons was 
essentially the same. The chi-square test for contingency was used to 
test tlie degree of association between two variables or categories. 

This association was considered to be significant if the probability of 
the calculated chi-square variable was equal to or less than 1 percent 
(or a .01 level of significance). When a significant chi-square value 
was obtained, it was necessary to determine which values of the two com- 
pared categories might be most responsible for the departure from inde- 
pendence. Those observed category frequencies whicli departed most from 
the frequencies expected if there were complete independence between the 
categories were, therefore, singled out. It was these marked departures 
of observed frequencies from expected frequencies which were considered 
to reveal occurences of most interest in the individualized instructional 
situations. 



Student Background and Completion Analysis 



The student background ant* completion analysis was basod on two 
types of student achievement information and several student background 
characteristics. The first student completion measure was that of the 
course grade received at the end of the fall 1S71 semester. According 
to the teacher’s judgment of a student’s level of achievement in a 



Summary descriptions of each one of these courses have been in- 
cluded in the Appendix. Included in. these descriptions are the course 
materials and equipment used and the general procedures followed in these 
individualized instructional situations. 
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